Method Effects in Factorial Surveys: An Analysis of Respondents' Comments, Interviewers' Assessments, and Response Behavior
نویسندگان
چکیده
This paper describes the implementation of a factorial survey within the SOEP-Pretest of 2008 and investigates (1) respondents’ comments about the vignettes, (2) interviewers’ assessments of respondents comprehension and willingness to answer, and (3) response behavior regarding response time, use of the answering scale, and consistency of evaluations by different age groups and educational background. The respondents evaluated 24 vignettes consisting of ten dimensions that described full-time employees and their gross earnings. The evaluation task was to assess whether the given earnings were just or unjust, and if they were rated as unjust, respondents had to specify the amount of injustice on an 100point rating scale. In regard to respondents’ comments, the critique mentioned most frequently by respondents referred to the content (unrealistic descriptions) and the number of the vignettes. The analysis of the interviewers’ assessments of respondents’ comprehension and willingness to answer revealed less comprehension and willingness to answer for older and less well educated respondents, although these differences were similar to those found for the complete questionnaire. The analysis of the response behavior revealed no differences of response time between the groups. Analyses of response consistency show that one should consider hints for simplifying heuristics: such heuristics can lead to an artificially high response consistency. The implications of the findings are discussed. JEL: C81, D63, J31 ∗This is a revised and shortened version of SOEPpaper No. 238. Contact: [email protected]
منابع مشابه
Research Project: The Factorial Survey as a Method for Measuring Attitudes in Population Surveys
The factorial survey is a research method of that combines the advantages of survey research with the advantages of experimental designs. Respondents react to hypothetical descriptions of objects or situations (vignettes) instead of answering single-item questions. By varying each dimension of the vignettes in an experimental design, the dimensions’ impact on respondents’ judgments or decisions...
متن کاملInterview Effects in an Environmental Valuation Telephone Survey
Because of the lack of markets for many environmental services, economists have turned to valuation surveys to estimate the value of these services. However, lack of market experience may cause respondents in valuation surveys to be more prone to interview effects than they would be with other opinion surveys. Without reference to market price or experience, respondents are less likely to have ...
متن کاملInterviewer effects in public health surveys.
Interviewer effects can have a substantial impact on survey data and may be particularly operant in public health surveys, where respondents are likely to be queried about racial attitudes, sensitive behaviors and other topics prone to socially desirable responding. This paper defines interviewer effects, argues for the importance of measuring and controlling for interviewer effects in health s...
متن کاملInterviewer Effects in an Environmental Valuation Telephone Survey
We investigate interviewer effects in a random digit dial telephone survey of recycling valuation and behavior. Lack of market experience with environmental goods may cause respondents to be more prone to interviewer effects during valuation surveys. Following previous research in both psychology and survey methodology, we test the direct effects of interviewer gender and race, as well as the i...
متن کاملNew challenges for interviewers when innovating social surveys: linking survey and objective data
The combination of survey data with more objective information, such as administrative records, is a promising innovation within social science research. The advantages of such projects are manifold, but implementing them also bears challenges to be considered. For example, the survey respondents typically have to consent to the linking of external data sources and interviewers have to feel com...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2014